Information processing apparatus and non-transitory computer readable medium storing information processing program

ABSTRACT

An information processing apparatus includes a processor configured to receive image data from a camera, detect a person and an object in the image data, receive information read from an IC chip on the object, the information being (i) personal information of the person or (ii) information used to retrieve the personal information of the person from a database, and execute a predetermined process using the personal information.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 fromJapanese Patent Application No. 2019-098790 filed May 27, 2019.

BACKGROUND Technical Field

The present disclosure relates to an information processing apparatusand a non-transitory computer readable medium storing an informationprocessing program.

Related Art

Japanese Unexamined Patent Application Publication No. 2012-068924discloses an authentication system that authenticates an IC cardincluding a memory that stores facial image data. In the IC card, datais encrypted such that a password specified in advance or dataassociated with the password is used as an encryption key. Theauthentication system for the IC card includes an imaging unit thatimages the face of a person subjected to authentication, an antenna thattransmits electromagnetic waves to and receives electromagnetic wavesfrom the IC card, a detector that detects the IC card based on theelectromagnetic waves transmitted and received via the antenna, a readerthat reads the facial image data from the IC card detected by thedetector, a comparer that compares the image of the face of the personsubjected to authentication, which is captured by the imaging unit,against the facial image data read by the reader, and an output unitthat outputs a comparison result obtained by the comparer. The imagingunit images the face of the person subjected to authentication after thedetector has detected the IC card. The reader acquires the passwordafter the imaging unit has imaged the face of the person subjected toauthentication, decrypts the data in the IC card based on the password,and acquires the facial image data stored in the IC card if the data isdecrypted successfully.

SUMMARY

Aspects of non-limiting embodiments of the present disclosure relate tothe following circumstances. If a process is performed by using personalinformation acquired from an IC chip, it is desirable that thereliability of the process be increased compared with a case where theprocess proceeds irrespective of whether a photo or a video containsboth a person and an object with the IC chip.

Aspects of certain non-limiting embodiments of the present disclosureaddress the above advantages and/or other advantages not describedabove. However, aspects of the non-limiting embodiments are not requiredto address the advantages described above, and aspects of thenon-limiting embodiments of the present disclosure may not addressadvantages described above.

According to an aspect of the present disclosure, there is provided aninformation processing apparatus comprising a processor configured toreceive image data from a camera, detect a person and an object in theimage data, receive information read from an IC chip on the object, theinformation being (i) personal information of the person or (ii)information used to retrieve the personal information of the person froma database, and execute a predetermined process using the personalinformation.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the present disclosure will be described indetail based on the following figures, wherein:

FIG. 1 is a schematic diagram of an example of an information processingapparatus, for describing authentication of a person according to eachexemplary embodiment;

FIG. 2 is a block diagram illustrating an example of the hardwareconfiguration of the information processing apparatus according to eachexemplary embodiment;

FIG. 3 is a block diagram illustrating an example of the functionalconfiguration of the information processing apparatus according to afirst exemplary embodiment;

FIG. 4 is a schematic diagram illustrating an example of a process forshooting a person and an object by using a photo/video shooting partaccording to the first exemplary embodiment;

FIG. 5 is a flowchart illustrating an example of an authenticationprocess according to the first exemplary embodiment;

FIG. 6 is a block diagram illustrating an example of the functionalconfiguration of an information processing apparatus according to asecond exemplary embodiment;

FIG. 7 is a schematic diagram illustrating an example of a process forshooting a person and an object by using the photo/video shooting partaccording to the second exemplary embodiment;

FIG. 8 is a schematic diagram illustrating an example of a process forshooting the object by using the photo/video shooting part according tothe second exemplary embodiment;

FIG. 9 is a schematic diagram illustrating an example of a process forshooting the object being brought closer to the near field communicatoraccording to the second exemplary embodiment;

FIG. 10 is a flowchart illustrating an example of an authenticationprocess according to the second exemplary embodiment;

FIG. 11 is a flowchart illustrating an example of the process forshooting the person by using the photo/video shooting part according tothe second exemplary embodiment; and

FIG. 12 is a flowchart illustrating an example of the process forshooting the object by using the photo/video shooting part according tothe second exemplary embodiment.

DETAILED DESCRIPTION First Exemplary Embodiment

A technology according to each embodiment of the present disclosure isdescribed below in detail with reference to the drawings. An informationprocessing apparatus according to each exemplary embodiment includes,but is not limited to, a camera that shoots a photo and/or a video, amonitor that displays what is in the shooting area of the camera andwhat is being shot by the camera, and a near field communicator thatacquires information from an IC chip. The information processingapparatus may acquire information from a camera and a near fieldcommunicator installed at different places and transmit an image to amonitor installed at a different place to display the image. The cameramay shoot a photo or a video. A video typically comprises a plurality ofstill images. As far as the present disclosure is concerned, the term“video” is not intended to be limiting to a video that exists as a videofile or a video recorded for later viewing. Furthermore, a plurality ofphotos that are captured and/or presented consecutively to captureand/or present a motion may also be regarded as a video.

FIG. 1 is a schematic diagram of an example of an information processingapparatus 1, for describing authentication of a person according to eachexemplary embodiment. The information processing apparatus 1 includes acamera 10, a monitor 11, and a near field communicator 12. For example,the information processing apparatus 1 according to each exemplaryembodiment is, but not limited to, a mobile terminal such as asmartphone or a tablet carried by a person 2. The information processingapparatus 1 may be a terminal such as a server connected to the camera10, the monitor 11, and the near field communicator 12.

An object 3 carried by the person 2 has an integrated circuit (IC) chip.The IC chip stores personal information of the person 2 for use inindividual identification, or information necessary to access thepersonal information of the person 2 that is stored in an externaldatabase. Examples of the personal information include a name, a date ofbirth, an address, an ID number, a preregistered image of the person 2,and a preregistered image of the object 3.

The camera 10 is provided at an upper central portion of the informationprocessing apparatus 1 to shoot a photo or video of the person 2 facingthe monitor 11. In each exemplary embodiment, the camera 10 is providedat the upper central portion of the information processing apparatus 1but may be provided, for example, at the center or a lower centralportion of the information processing apparatus 1 depending onenvironments. In each exemplary embodiment, the camera 10 is, but notlimited to, a monocular camera. The camera 10 may be a different type ofcamera such as a stereoscopic camera.

The monitor 11 displays real-time feedback of what is present in theshooting area of the camera 10. Examples of the monitor 11 include aliquid crystal monitor, a cathode ray tube (CRT) monitor, and a flatpanel display (FPD) monitor.

The near field communicator 12 performs near field communication bytransmitting radio waves to the IC chip on the object 3 to acquireinformation from the IC chip. The near field communicator 12 may have afunction of writing information in the IC chip. The near fieldcommunicator 12 according to each exemplary embodiment is provided belowthe camera 10 and the monitor 11 but may be provided, for example, aboveor on the side of the monitor 11.

FIG. 2 is a block diagram illustrating an example of the hardwareconfiguration of the information processing apparatus 1 according toeach exemplary embodiment. As illustrated in FIG. 2, the informationprocessing apparatus 1 according to each exemplary embodiment includesthe camera 10, the monitor 11, the near field communicator 12, a centralprocessing unit (CPU) 13, a read only memory (ROM) 14, a random accessmemory (RAM) 15, a storage 16, a communication interface (communicationI/F) 17, and a loudspeaker 18. The camera 10, the monitor 11, the nearfield communicator 12, the CPU 13, the ROM 14, the RAM 15, the storage16, the communication I/F 17, and the loudspeaker 18 are connected by abus 19.

The CPU 13 controls the overall information processing apparatus 1. TheROM 14 stores various programs including an information processingprogram and various types of data for use in each exemplary embodiment.The RAM 15 is a memory to be used as a working area during execution ofvarious programs. The CPU 13 loads a program stored in the ROM 14 on theRAM 15 and executes the program to verify the person 2 and the object 3.Examples of the storage 16 include a hard disk drive (HDD), a solidstate drive (SSD), and a flash memory. The storage 16 may store theinformation processing program. The communication I/F 17 transmits andreceives data. The loudspeaker 18 outputs sound.

The object 3 includes an antenna 31 and an IC chip 32. In response to aradio wave received from the near field communicator 12, the antenna 31receives information from or transmits information to the near fieldcommunicator 12. The IC chip 32 stores the personal information of theperson 2.

Next, the functional configuration of the information processingapparatus 1 is described. FIG. 3 is a block diagram illustrating anexample of the functional configuration of the information processingapparatus according to a first exemplary embodiment.

As illustrated in FIG. 3, the information processing apparatus 1includes a communication part 101, a photo/video shooting part 102, anacquisition part 103, a control part 104, a display part 105, aprocessing part 106, and a notification part 107. The CPU 13 executesthe information processing program and controls the hardware to functionas the communication part 101, the photo/video shooting part 102, theacquisition part 103, the control part 104, the display part 105, theprocessing part 106, and the notification part 107.

The communication part 101 performs near field communication with the ICchip 32 on the object. The communication part 101 is typically a readerthat can read information from the IC chip 32 by near fieldcommunication. Specifically, the communication part 101 performs nearfield communication with the object 3 to receive the personalinformation stored in the object 3 or the information necessary toaccess the personal information of the person 2 that is stored in theexternal database. The communication part 101 transmits data to andreceives data from an external server or terminal. The photo/videoshooting part 102 corresponds to the camera 10 in FIG. 2.

The acquisition part 103 acquires personal information for use inindividual identification from the IC chip 32 on the object 3.Specifically, the acquisition part 103 acquires personal informationfrom the object 3 via the communication part 101. The acquisition part103 acquires image data from the photo/video shooting part 102. Imagedata is typically a photo or a video but they are not necessarilypresent as a file or saved for later viewing.

The control part 104 analyzes the image data acquired from thephoto/video shooting part 102 by the acquisition part 103. If the imagedata contains both the person 2 and the object 3 with the IC chip 32,the control part 104 permits a process using the personal informationacquired from the IC chip 32 after the image data is acquired. If theimage data does not contain at least one of the person 2 or the object 3with the IC chip 32, the control part 104 forbids the process using theacquired personal information.

The display part 105 displays, on a screen, what is present in theshooting area of the photo/video shooting part 102. The display part 105displays, on the screen, predetermined frames to guide positions ofshooting targets.

The processing part 106 performs the process using the personalinformation if the control part 104 recognizes the person 2 and theobject 3. The notification part 107 provides at least one of an audioguide, an image guide, or a text guide.

The object 3 includes a transmission part 301 and a storage part 302.The transmission part 301 receives radio waves from the near fieldcommunicator 12 and transmits the personal information stored in thestorage part 302 to the communication part 101. The storage part 302stores the personal information.

Next, a method for verification of the person 2 in the informationprocessing apparatus 1 is described with reference to FIG. 4 prior todescription of operations of the information processing apparatus 1.FIG. 4 is a schematic diagram illustrating an example of a process forverification of the person 2 by shooting of a photo and a video of theperson 2 and the object 3 according to the first exemplary embodiment.The process takes place at the information processing apparatus 1.Below, the video is used as an example of image data coming from thephoto/video shooting part 102.

The object 3 has at least one of a character string, an image of theperson 2, or a shape. The personal information contains at least one ofinformation on a preregistered character string, information on apreregistered image of the person, or information on a preregisteredshape. As a verification method, the control part 104 verifies whetherat least one of the information on the character string, the informationon the image of the person, or the information on the shape contained inthe personal information corresponds to at least one of information onthe character string, information on the image of the person 2, orinformation on the shape obtained by analyzing the image data from thephoto/video shooting part 102. The correspondence means that theinformation contained in the personal information and the informationobtained by analyzing the image data from the photo/video shooting part102 are presumably identical to each other. In terms of matching, thepresent disclosure does not require an exact sameness. It is determinedthat the information contained in the personal information correspondsto the information obtained by analyzing the image data from thephoto/video shooting part 102 if there is a match to the extent thatthey are presumably identical to each other. Examples of a method foranalyzing the image data from the photo/video shooting part 102 includea method that involves extracting, as feature points, features such aseyes, a nose, a mouth, a profile, and a color of the person 2 and theobject 3 in the image data. That is, the image data acquired from thephoto/video shooting part 102 may be compared against the preregisteredimage data (e.g., photo, video) by, for example, comparing featurepoints extracted from the acquired image data and feature points in thepreregistered image data.

In this exemplary embodiment, examples of the object 3 include an IDcard (for example, a driver's license) of the person 2 with an image ofthe person 2, and a character string showing his/her name and address.The object 3 (ID card in this case) has the IC chip 32 which storespersonal information indicating the image of the person 2 and thecharacter string showing his/her name and address. The object 3 and theIC chip 32 are not limited thereto. The object 3 may have any color,pattern, or shape.

The display part 105 of the information processing apparatus 1 displayswhat is present in the shooting area of the photo/video shooting part102, and overlays a predetermined frame 40 to guide the position of theperson 2, and a predetermined frame 41 to guide the position of theobject 3.

To help the person 2 to shoot a photo or a video of the person 2 and theobject 3, the control part 104 causes the notification part 107 toprovide a prompt to adjust the position of the person 2 as guided by theframe 40 and the position of the object 3 as guided by the frame 41. Theframes 40 and 41 may be displayed at the same time, so that both theperson 2 and the object 3 can be in a photo shot or a video frame.

The control part 104 acquires image data (e.g., photo, video) from thephoto/video shooting part 102. The control part 104 analyzes the imagedata and determines whether the person 2 and the object 3 are present inthe image data based, for example, on whether the person 2 fits in thepredetermined frame 40 and the object 3 fits in the predetermined frame41.

If the person 2 and the object 3 have been recognized in the image data,the control part 104 acquires the personal information and performs aprocess using the personal information. If the person 2 or the object 3has not been recognized because the person 2 does not fit in thepredetermined frame 40 or the object 3 does not fit in the predeterminedframe 41, the control part 104 instructs the person 2 to shoot a betterphoto or video so that the person 2 and the object 3 can be recognizedin the photo or video.

Specifically, if the person 2 and the object 3 have been recognized, thecontrol part 104 acquires the personal information from the IC chip 32on the object 3 and the communication part 101 transmits the personalinformation acquired from the IC chip 32 and the image data acquiredfrom the photo/video shooting part 102 to a terminal or server installedat a distance. If at least one of the person 2 or the object 3 has notbeen recognized, the person 2 is instructed to shoot a better photo orvideo, so that both the person 2 and the object 3 can be recognized fromthe photo or video.

In this exemplary embodiment, the person 2 is instructed to shoot abetter photo or video to include both the person 2 and the object 3 ifat least one of the person 2 or the object 3 has not been recognized,but the person 2 may be instructed to shoot a photo or video to includewhat was not recognized in the previous photo or video acquired from thephoto/video shooting part 102. For example, if the person 2 and theobject 3 are present in the previous photo or video but the control part104 recognizes the object 3 does not fit in the predetermined frame 41,the person 2 may be instructed to reshoot a photo or video of the object3. The control part 104 compares the object 3 in the new photo or videoagainst the object 3 in the previous photo or video, and if they match,transmits a photo shot or a video frame that contains the person 2 and aphoto shot or a video frame that contains the object 3.

It may also be possible to configure the control part 104 to forbid theprocess using the personal information if at least one of the person 2or the object 3 has not been recognized. For example, if at least one ofthe person 2 or the object 3 has not been recognized, the control part104 may store the image data in the storage of the informationprocessing apparatus 1 or transmit the image data to a server or thelike installed at a different place.

Next, operations of the information processing program according to thisexemplary embodiment are described with reference to FIG. 5. FIG. 5 is aflowchart illustrating an example of an authentication process accordingto the first exemplary embodiment. The CPU 13 reads the informationprocessing program from the ROM 14 or the storage 16 and executes theinformation processing program to execute the authentication processillustrated in FIG. 5. For example, the authentication processillustrated in FIG. 5 is executed when a user starts the informationprocessing apparatus 1 and inputs an instruction to execute theinformation processing program.

In Step S101, the CPU 13 determines whether authentication is started.If authentication is started (Step S101: YES), the CPU 13 proceeds toStep S102. If authentication is not started (Step S101: NO), the CPU 13waits for the start of authentication.

In Step S102, the CPU 13 acquires a photo or video from the photo/videoshooting part 102.

In Step S103, the CPU 13 analyzes the photo or video to detect theperson 2 and the object 3.

In Step S104, the CPU 13 determines whether the person 2 and the object3 are detected in the predetermined frames. If the person 2 and theobject 3 are detected (Step S104: YES), the CPU 13 proceeds to StepS105. If at least one of the person 2 or the object 3 is not detected(Step S104: NO), the CPU 13 proceeds to Step S102.

In Step S105, the CPU 13 acquires the personal information from the ICchip 32 and performs a process using the personal information.

Second Exemplary Embodiment

In the first exemplary embodiment, the process using the personalinformation is performed if the person 2 and the object 3 have beenrecognized in the image data from the photo/video shooting part 102. Inthis second exemplary embodiment, the process using the personalinformation is performed if the person 2 is detected to perform apredetermined action in image data from the photo/video shooting part102. The structure of the information processing apparatus 1 accordingto this exemplary embodiment (see FIG. 1) and the hardware configurationof the information processing apparatus 1 (see FIG. 2) are similar tothose in the first exemplary embodiment and description thereof isomitted.

The functional configuration of the information processing apparatus 1is described with reference to FIG. 6. FIG. 6 is a block diagramillustrating an example of the functional configuration of theinformation processing apparatus 1 according to the second exemplaryembodiment. In FIG. 6, the same functional components as those of theinformation processing apparatus 1 illustrated in FIG. 3 are representedby the same reference symbols as those in FIG. 3 and description thereofis omitted.

A control part 114 analyzes image data acquired by the acquisition partand checks whether the image data contains both the person 2 and theobject 3 with the IC chip 32. If the image data does not contain atleast one of the person 2 or the object 3 with the IC chip 32, thecontrol part 114 forbids a process using the personal informationacquired from the IC chip 32. If determination is made, as a result ofthe image data analysis, that the person 2 holds the object 3 andperforms a predetermined action, the control part 114 performs theprocess using the personal information. The predetermined actionaccording to this exemplary embodiment refers to such an action that theperson 2 brings the object 3 closer to the communication part 101 fornear field communication.

A display part 115 displays, on a screen, a real-time feedback of whatis in the shooting area of the photo/video shooting part 102 while imagedata is being received from the photo/video shooting part 102. Thedisplay part 115 overlays, on the screen, predetermined frames to guidethe positions of the person 2 and the object 3 at a moment, and overlaysjust a predetermined frame to guide the position of the object 3 atanother moment.

A notification part 117 provides at least one of an audio guide, animage guide, or a text guide. If at least one of the person 2 or theobject 3 is not positioned as guided by the predetermined frame on thescreen of the display part 115, the notification part 117 provides aprompt to adjust the position of the person 2 or the object 3 as guidedby the predetermined frame. If more than one person 2 or more than oneobject 3 is detected in the predetermined frame on the screen of thedisplay part 115, the notification part 117 provides a prompt to placeonly one person 2 or only one object 3 in the predetermined frame.

The control part 114 causes the notification part 117 to provide theperson 2 with a prompt to shoot a photo or video of the person 2 and theobject 3. The control part 114 causes the notification part 117 toprompt the person 2 to change the position of the object 3 so as tochange the distance between the person 2 and the object 3. If the person2 and the object 3 cannot be extracted from the photo or video, thecontrol part 114 causes the notification part 117 to give a notificationthat the person 2 and the object 3 cannot be extracted from the photo orvideo.

Next, a method for verifying the person 2 in the information processingapparatus 1 is described with reference to FIGS. 7, 8, and 9 prior todescription of operations of the information processing apparatus 1.First, a method for instructing the user to shoot a photo or video ofthe person 2 and the object 3 for verification is described withreference to FIG. 7. FIG. 7 is a schematic diagram illustrating anexample of a process for shooting the person 2 and the object 3 by usingthe photo/video shooting part 102 according to the second exemplaryembodiment.

As illustrated in FIG. 7, to guide the person 2 to shoot a photo or avideo of the person 2 and the object 3, the control part 114 causes thenotification part 117 to provide the person 2 with a prompt to place theperson 2 so as to fit in the frame 40 and to place the object 3 so as tofit in the frame 41 displayed on the screen. If the user is notsuccessful in shooting a photo or video that includes the person 2 andthe object 3, the control part 114 causes the notification part 117 togive a notification that the user is not successful.

Specifically, if at least one of the person 2 or the object 3 is notpositioned as guided by the frame 40 or 41, the control part 114 causesthe notification part 117 to provide the person 2 with a prompt toadjust the position of the person 2 as guided by the frame 40 or theposition of the object 3 as guided by the frame 41. If more than oneperson 2 is detected in the frame 40 or if more than one object 3 isdetected in the frame 41, the control part 114 causes the notificationpart 117 to provide a prompt to place only one person 2 or only oneobject 3 in the frame 40 or 41. If the person 2 does not fit in theframe 40 or if the object 3 does not fit in the frame 41, the controlpart 114 causes the notification part 117 to provide a prompt to fit theperson 2 in the frame 40 or the object 3 in the frame 41.

If the person 2 is successful in shooting a photo or a video thatincludes the person 2 and the object 3, the control part 114 causes thenotification part 117 to provide the person 2 with a prompt to bring theobject 3 closer to the information processing apparatus 1.

Next, shooting of the object 3 brought closer to the informationprocessing apparatus 1 is described with reference to FIG. 8. FIG. 8 isa schematic diagram illustrating an example of a shooting process of theobject 3 in the information processing apparatus according to the secondexemplary embodiment.

As illustrated in FIG. 8, the display part 115 of the informationprocessing apparatus 1 displays what is present in the shooting area ofthe photo/video shooting part 102 (the person 2 and the object 3 in thisfigure) and also displays a predetermined frame 42 to guide the positionof the object 3.

To shoot the object 3 up close to include details that are visiblypresent on the object 3, the control part 114 causes the notificationpart 117 to provide the person 2 with a prompt to adjust the position ofthe object 3 as guided by the frame 42. If the close-up shooting of theobject 3 is not successful, the control part 114 causes the notificationpart 117 to give the person 2 a notification that the close-up shootingof the object 3 is not successful.

Specifically, if the object 3 is not positioned as guided by the frame42, the control part 114 causes the notification part 117 to provide theperson 2 with a prompt to adjust the position of the object 3 as guidedby the frame 42. If more than one object 3 is detected in the frame 42,the control part 114 causes the notification part 117 to provide theperson 2 with a prompt to place only one object 3 in the frame 42. Ifthe object 3 does not fit in the frame 42, the control part 114 causesthe notification part 117 to provide the person 2 with a prompt to fitthe object 3 in the frame 42. Here, the word “close-up shooting” is notintended to limiting to shooting a photo or video that only includes theobject 3.

If the close-up shooting of the object 3 is successful, the control part114 analyzes a photo shot or a video frame that contains the person 2and the object 3 and a photo shot or a video frame that contains theobject 3. If the image analysis shows that the distance between theperson 2 and the object 3 has changed, the control part 114 causes thenotification part 117 to provide the person 2 with a prompt to bring theobject 3 further closer to the near field communicator 12. If theshooting of details of the appearance of the object 3 is not successful,the control part 114 causes the notification part 117 to notify theperson 2 that the shooting of details of the appearance of the object 3is not successful.

Next, with reference to FIG. 9, shooting of the object 3 being broughteven closer to the near field communicator 12 than it was in FIG. 8 isdescribed. FIG. 9 is a schematic diagram illustrating an example of aprocess for shooting the object 3 being brought closer to the near fieldcommunicator 12 according to the second exemplary embodiment.

As illustrated in FIG. 9, the display part 115 of the informationprocessing apparatus 1 displays what is present in the shooting area ofthe photo/video shooting part 102 (the person 2 and the object 3 in thisfigure), and displays a predetermined frame 43 to guide the position ofthe object 3. To shoot the object 3 being brought closer to the nearfield communicator 12, the display part 115 displays the predeterminedframe 43 to guide the position of the object 3 by enlarging thepredetermined frame 42.

If the shooting of the object 3 being brought closer to the near fieldcommunicator 12 is successful, the control part 114 compares the object3 in photo shots or video frames at different moments (e.g., FIG. 8 andFIG. 9). If the control part 114 determines that the object 3 has beenbrought closer, for example, because the size of the object 3 hasincreased from FIG. 8 to FIG. 9, the acquisition part 103 acquires thepersonal information from the object 3. If the control part 114 does notdetermine that the object 3 has not been recognized to have been broughtcloser, the control part 114 determines whether a predetermined periodhas elapsed. If the predetermined period has not elapsed, the controlpart 114 instructs the person 2 to bring the object 3 closer. If thepredetermined period has elapsed, the control part 114 instructs theperson 2 to place the object 3 and him/herself together as shown in FIG.7 again, and then to move the object 3 closer to the near fieldcommunicator 12.

In this exemplary embodiment, the action of bringing the object 3 closerto the near field communicator 12 is used as an example of thepredetermined action. However, the predetermined action is not limitedthereto. An action of raising the hand of the person 2, an action ofturning the body of the person 2 to look backward, and an action ofbringing the object 3 away from the near field communicator 12 are alsoexamples of the predetermined action.

In this exemplary embodiment, determination is made that the object 3 isbrought closer if the size of the object 3 in photo shots or videoframes at different moments increases. This is just an example and thedetermination can be made in other ways too. The information processingapparatus 1 may further include or be connected to a photo/videoshooting part 102 that shoots the person 2 from the side and recognizesthe person 2 bringing the object 3 closer to the near field communicator12 based on image data from the another photo/video shooting part 102.The information processing apparatus 1 may further include a photo/videoshooting part 102 that shoots the person 2 from the side and measuresthe distance between the person 2 and the object 3 or the distancebetween the information processing apparatus 1 and the object 3 torecognize the person 2 bringing the object 3 closer to the near fieldcommunicator 12.

The predetermined period according to this exemplary embodiment is thetime from the prompt to bring the object 3 closer to the near fieldcommunicator 12 to the moment when the size of the object 3 becomeslarger than a predetermined size in a photo shot or a video frame. Thepredetermined period is not limited thereto. The predetermined periodmay be a period that has elapsed from the prompt to bring the object 3closer to the near field communicator 12.

If the object 3 is recognized to have been brought closer, theacquisition part 103 acquires the personal information from the IC chipon the object 3 and the control part 114 verifies the person 2 and theobject 3 in image data from the photo/video shooting part 102 againstthe personal information acquired from the IC chip on the object 3 toauthenticate the person 2. More specifically, the control part 114 mayverify the person 2 and the object 3 as captured by photo shots or videoframes against the personal information acquired from the IC chip on theobject 3 to authenticate the person 2.

As a verification method, the control part 114 analyzes the object 3 ascaptured by the image data and extracts information about the person 2from the object 3 as captured by the image data. Examples of theinformation about the person 2 extracted from the object 3 as capturedby the image data include a photo, name, and address of the person 2that are visibly present on the object 3. The control part 114 comparesthe information about the person 2 that has been extracted from theobject 3 as captured by the image data against the personal informationacquired from the IC chip 32 on the object 3. More specifically, theobject 3 as captured by a photo shot or a video frame in FIG. 8 or FIG.9 may be analyzed to extract the information about the person 2 and maybe compared against the personal information acquired from the IC chip32 on the object 3.

The control part 114 analyzes the person 2 as captured by the image dataand compares the person 2 as captured by the image data against thephoto of the person extracted from the object 3 as captured by the imagedata. More specifically, the person 2 as captured by a photo shot or avideo frame in FIG. 7 may be analyzed and be compared against the photoof the person 2 extracted from the object 3 as captured by the imagedata.

If these comparisons find matches, the control part 114 authenticatesthe person 2.

In this exemplary embodiment, a photo shot or video frame that containsthe person 2 and the object 3, a photo shot or video frame that containsthe object 3, and the personal information are acquired in this order.The order of acquisition is not limited thereto and may be changed. Forexample, the personal information may be acquired first and then a photoshot or video frame that contains the object 3 and a photo shot or videoframe that contains the person 2 and the object 3 may be acquired.

Next, operations of the information processing program according to thisexemplary embodiment are described with reference to FIGS. 10, 11, and12. FIG. 10 is a flowchart illustrating an example of an authenticationprocess according to the second exemplary embodiment. The CPU 13 readsthe information processing program from the ROM 14 or the storage 16 andexecutes the information processing program to execute theauthentication process illustrated in FIG. 10. For example, theauthentication process illustrated in FIG. 10 is executed when the userstarts the information processing apparatus 1 and inputs an instructionto execute the information processing program.

In Step S111, the CPU 13 shoots the person 2 and the object 3 by usingthe photo/video shooting part 102.

In Step S112, the CPU 13 causes the notification part 117 to prompt theperson 2 to bring the object closer.

In Step S113, the CPU 13 shoots the object 3 by using the photo/videoshooting part 102.

In Step S114, using image data received from the photo/video shootingpart 102, the CPU 13 analyzes a photo shot or a video frame thatcontains the person 2 and the object 3 and also analyzes a photo shot ora video frame that contains the object 3 to recognize a positionalrelationship between the person 2 and the object 3 and details of theappearance of the object 3.

In Step S115, the CPU 13 determines whether the distance between theperson 2 and the object 3 has changed. If the distance has changed (StepS115: YES), the CPU 13 proceeds to Step S117. If the distance has notchanged (Step S115: NO), the CPU 13 proceeds to Step S116.

In Step S116, the CPU 13 causes the notification part 117 to give anotification to the person 2 that the distance between the person 2 andthe object 3 has not changed.

In Step S117, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to bring the object 3 closer to the near fieldcommunicator 12.

In Step S118, the CPU 13 causes the notification part 117 to guide theperson 2 to shoot, by the photo/video shooting part 102, the object 3being brought closer to the near field communicator 12.

In Step S119, the CPU 13 analyzes image data received from thephoto/video shooting part 102 to recognize the person 2 performing apredetermined action. The predetermined action may, for example, bebringing the object 3 closer to the near field communicator 12.

In Step S120, the CPU 13 determines whether the predetermined action bythe person 2 has been recognized. If the predetermined action by theperson 2 has been recognized (Step S120: YES), the CPU 13 proceeds toStep S122. If the predetermined action by the person 2 has not beenrecognized (Step S120: NO), the CPU 13 proceeds to Step S121.

In Step S121, the CPU 13 determines whether the predetermined period haselapsed. If the predetermined period has elapsed (Step S121: YES), theCPU 13 proceeds to Step S111. If the predetermined period has notelapsed (Step S121: NO), the CPU 13 proceeds to Step S118.

In Step S122, the CPU 13 performs near field communication with theobject 3 to acquire personal information from the IC chip 32 on theobject 3.

In Step S123, the CPU 13 compares the personal information againstresults of analysis of image data of the person 2 and the object 3received from the photo/video shooting part 102.

In Step S124, the CPU 13 determines whether there is a match as a resultof the comparison. If there is a match as a result of the comparison(Step S124: YES), the CPU 13 proceeds to Step S125. If there is no matchas a result of the comparison (Step S124: NO), the CPU 13 proceeds toStep S126.

In Step S125, the CPU 13 transmits a photo shot or a video frame thatcontains the person 2 and the object 3, a photo shot or a video framethat contains the object 3, and the personal information to a server.

In Step S126, the CPU 13 causes the notification part 117 to give theperson 2 a notification that there is no match as a result of thecomparison.

Next, the process for shooting a photo/video of the person and theobject according to an exemplary embodiment is described with referenceto FIG. 11. FIG. 11 is a flowchart illustrating an exemplary process forshooting the person and the object using the photo/video shooting part102 according to the second exemplary embodiment. The CPU 13 reads aprogram from the ROM 14 or the storage 16 and executes the program toexecute the process for shooting the person illustrated in FIG. 11. Forexample, the process illustrated in FIG. 11 is executed when theinformation processing program gives an instruction to execute theprocess for shooting a photo or a video of the person.

In Step S201, the CPU 13 shoots, by using the photo/video shooting part102, a photo or a video.

In Step S202, the CPU 13 analyzes the image data (the photo or video)received from the photo/video shooting part 102 and determines whetherthe person 2 and the object 3 are detected in the image data. Morespecifically, the CPU 13 determines whether the person 2 and the object3 are detected in predetermined frames. If the person 2 and the object 3are detected (Step S202: YES), the CPU 13 proceeds to Step S204. If noperson 2 or no object 3 is detected (Step S202: NO), the CPU 13 proceedsto Step S203.

In Step S203, the CPU 13 causes the notification part 117 to give theperson 2 a notification that no person 2 or no object 3 is detected inthe predetermined frame.

In Step S204, the CPU 13 determines whether only one person 2 and onlyone object 3 are detected in the predetermined frames. If only oneperson 2 and only one object 3 are detected (Step S204: YES), the CPU 13proceeds to Step S206. If only one person 2 or only one object 3 is notdetected (Step S204: NO), the CPU 13 proceeds to Step S205.

In Step S205, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to place only one person 2 or only one object 3.

In Step S206, the CPU 13 determines whether the person 2 and the object3 fit in the predetermined frames. If the person 2 and the object 3 fitin the predetermined frames (Step S206: YES), the CPU 13 proceeds toStep S208. If the person 2 or the object 3 does not fit in thepredetermined frame (Step S206: NO), the CPU 13 proceeds to Step S207.

In Step S207, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to fit the person 2 or the object 3 in thepredetermined frame.

In Step S208, the CPU 13 stores a photo shot or a video frame thatcontains the person 2 and the object 3 in the RAM 15 and terminates theshooting process. The CPU 13 may store an entire video which comprisesthe video frame that contains the person 2 and the object 3.

Next, the process for shooting the object by using the photo/videoshooting part 102 according to an exemplary embodiment is described withreference to FIG. 12. FIG. 12 is a flowchart illustrating an example ofthe process for shooting the object according to the second exemplaryembodiment. The CPU 13 reads a program from the ROM 14 or the storage 16and executes the program to execute the process for shooting the objectillustrated in FIG. 12. For example, the process illustrated in FIG. 12is executed when the information processing program gives an instructionto execute the process for shooting a photo or a video of the object.

In Step S301, the CPU 13 shoots, by using the photo/video shooting part102, a photo or a video.

In Step S302, the CPU 13 analyzes the image data (the photo or video)received from the photo/video shooting part 102 and determines whetherthe object 3 is detected in a predetermined frame in the image data. Ifthe object 3 is detected (Step S302: YES), the CPU 13 proceeds to StepS304. If no object 3 is detected (Step S302: NO), the CPU 13 proceeds toStep S303.

In Step S303, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to adjust the position of the object 3 as guidedby the predetermined frame.

In Step S304, the CPU 13 determines whether only one object 3 isdetected in the predetermined frame. If only one object 3 is detected(Step S304: YES), the CPU 13 proceeds to Step S306. If only one object 3is not detected (Step S304: NO), the CPU 13 proceeds to Step S305.

In Step S305, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to place only one object 3.

In Step S306, the CPU 13 determines whether the object 3 fits in thepredetermined frame. If the object 3 fits in the predetermined frame(Step S306: YES), the CPU 13 proceeds to Step S308. If the object 3 doesnot fit in the predetermined frame (Step S306: NO), the CPU 13 proceedsto Step S307.

In Step S307, the CPU 13 causes the notification part 117 to provide theperson 2 with a prompt to fit the object 3 in the predetermined frame.

In Step S308, the CPU 13 stores a photo shot or a video frame thatcontains the object 3 in the RAM 15 and terminates the photo/videoshooting process. The CPU 13 may store an entire video which comprisesthe video frame that contains the object 3.

In this exemplary embodiment, the predetermined process that isperformed upon a match as a result of the comparison is transmission, toa server, of image data of the person 2 and the object 3 received fromthe photo/video shooting part 102 and the personal information of theperson 2 acquired from the IC chip 32 on the object 3. The informationprocessing apparatus 1 is not limited thereto. The informationprocessing apparatus 1 may have or be accessible to a storage thatstores personal information of the person 2, compare the acquiredpersonal information against the stored personal information, and unlocka door or the like if there is a match as a result of the comparison.

In this exemplary embodiment, the personal information is stored in theIC chip 32 but may be stored in the storage 16 of the informationprocessing apparatus 1. For example, the IC chip 32 may storeinformation uniquely determined for each target person (hereinafterreferred to as “target person key”) and the information processingapparatus 1 may store the personal information and the target person keyin association with each other. The information processing apparatus 1may acquire the target person key from the IC chip 32 and identify andacquire the personal information by using the target person key.

The personal information may be stored in each of the IC chip 32 and thestorage 16 of the information processing apparatus 1. For example, eachof the IC chip 32 and the information processing apparatus 1 may storethe personal information and the information processing apparatus 1 maycompare the personal information acquired from the IC chip against thepersonal information stored in the information processing apparatus 1.

As described above, according to this exemplary embodiment, the person 2is not verified if the predetermined action of the person 2 is notrecognized when the photo shot or the video frame that contains theperson 2 and the object 3, the photo shot or the video frame thatcontains the object 3, and the personal information are compared.

In this exemplary embodiment, the camera 10 may shoot a photo or videoof the front of the person 2. The camera 10 is not limited thereto.Cameras 10 may be installed at a plurality of places and may shootphotos and videos of the front and sides of the person 2 to recognize achange in the positional relationship between the person 2 and theobject 3 from image data from a side camera.

In this exemplary embodiment, after the predetermined action has beenrecognized, comparison is made by using the photo shot or video framethat contains the person 2 and the object 3, the photo shot or videoframe that contains the object 3, and the personal information. If thereis a match as a result of the comparison, the image data and thepersonal information are transmitted to a server. The informationprocessing apparatus 1 is not limited thereto. The image data and thepersonal information may be transmitted to a server upon recognition ofthe predetermined action.

EXAMPLES

Next, examples of the exemplary embodiments of the present disclosureare described.

Example 1

First, description is made of an example of the exemplary embodiments ofthe present disclosure in which personal information is registered andpersonal identification is verified when, for example, a bank account isopened. In this example, the information processing apparatus 1 is aterminal such as a smartphone carried by a user.

After the user has filled in an input form, the terminal initiates aprocess for shooting a video to include a video frame that contains boththe user and his/her driver's license (first data). The terminaldisplays a message “Please have your driver's license ready.” on ascreen. The terminal activates a camera function. The terminal displays,on a screen, a message “Please show yourself and your driver's licenseto the camera. You and your driver's license must fit in the framesdisplayed on the screen.” and displays the frames and what is present inthe shooting area of the camera. If the user and/or his/her driver'slicense are misplaced, the terminal displays, on the screen, a message“Please adjust positions of yourself and your driver's license to fit inthe frames.” If more than one user or more than one driver's license isdetected, the terminal displays, on the screen, a message “Please fitonly one user and only one driver's license in the frames”.

When the user and his/her driver's license are present in a video frameof the video, the terminal continues to shoot the video to furtherinclude a video frame in which a close-up of the driver's license ispresent (second data). The terminal displays, on the screen, a message“Please bring your driver's license closer to the camera to fit in theframe displayed on the screen.” and a frame that is bigger than theframe for the driver's license displayed at an earlier stage. If thedriver's license does not fit in or is not detected in the frame in avideo frame of the video, the terminal displays, on the screen, amessage “Please fit your driver's license in the frame”. If more thanone driver's licenses are detected, the terminal displays, on thescreen, a message “Please fit only one driver's license in the frame.”

When the video includes a video frame with a close-up of the driver'slicense (second data), the terminal extracts and compares the user inthe first data and the photo on the driver's license in the second data.

The terminal then displays a message “Please bring your driver's licensecloser to the near field communicator of the terminal.” on the screen.The terminal performs near field communication with an IC chip on thedriver's license via the near field communicator to acquire data aboutthe user including the name, address, and facial image of the userstored in the IC chip (third data). The terminal extracts data about theuser (e.g., name, address, and facial image) printed on the driver'slicense from the close up of the driver's license and compares the thirddata against the data about the user extracted from the close up.

If there is a match as a result of the comparison, the terminal displaysa message “Personal identification is done.” on the screen and transmitsany information input on the form by the user, the first data, thesecond data, and the third data to a server that manages information ofthe user. If there is no match as a result of the comparison, theterminal displays a message “Personal identification has failed. Pleasephotograph again.” on the screen and keeps the camera function activefor shooting another video.

Example 2

Next, description is made of an example of the exemplary embodiments ofthe present disclosure in which attendance of telecommuting is managed.In this example, the information processing apparatus 1 is a server thatacquires personal information or the like from a terminal such as asmartphone carried by a user and gives notifications to the terminal.

In response to an execution instruction from the mobile terminal of theuser, the server displays a message “Do you want to register the hoursyou worked?” on a screen of the mobile terminal. If the server hasreceived a registration instruction from the user, the server activatesa camera function of the mobile terminal and displays, on the screen ofthe mobile terminal, a message “Please adjust positions of yourself andyour employee ID card to fit in the frames displayed on the screen.” Themobile terminal sends a photo that includes the user and his/heremployee ID card. The server analyzes the photo. If the ID photo of theperson printed on the employee ID card matches the user as a result ofthe analysis, the server accepts registration of hours the user worked.If the user or his/her employee ID card has not been recognized in thereceived photo, the server displays a message “You or your employee IDcard was not recognized. Registration process is terminated.” on thescreen of the mobile terminal and terminates the registration processwithout accepting registration of the hours the user worked.

Example 3

Next, description is made of an example of the exemplary embodiments ofthe present disclosure in which a door is unlocked (with a smart key).In this example, the information processing apparatus 1 is a door phoneinstalled at an entrance of the user's home.

If a call button is pressed, the door phone displays a message “Showyourself and your ID card to the camera.” on a screen and activates acamera at the door phone. The camera shoots whatever in its shootingarea. Once the user and his/her ID card have been recognized from thevideo, the door phone displays a message “Please bring your ID cardcloser to the communicator of the door phone.” on the screen. The cameraat the door continues to shoot while the user brings his/her ID cardcloser to the near field communicator. The door phone analyzes the videoto recognize the user bringing his/her ID card closer to the near fieldcommunicator so that the near field communicator of the door phone canperform near field communication with the ID card. If the action of theuser for bringing his/her ID card closer has been recognized based onthe analysis of the video, the door phone transmits, to a terminal of amanager, information acquired from an IC chip, image data of the userand his/her ID card, and an inquiry as to whether to unlock the door.The door phone unlocks the door in response to a response from themanager to indicate a permission to unlock the door. If the action ofthe user for bringing his/her ID card closer has not been recognized,the door phone displays a message “The action of bringing your ID cardcloser was not recognized.” on the screen and terminates the process. clExample 4

Next, description is made of an example of the exemplary embodiments ofthe present disclosure in which a key is created by using the shape ofthe object 3 and a door is unlocked with the key. In this example, theinformation processing apparatus 1 is a door phone installed at anentrance of a user's home.

An IC chip prestores an identification number uniquely determined foreach object. A storage of the door phone prestores information about thethree-dimensional shape of the object, a facial image of the user, andan identification number. If a call button is pressed, the door phoneplays a message “Show yourself and your key object to the camera.” byusing a loudspeaker and activates a camera at the door phone. The camerashoots whatever in its shooting area. Once the user and his/her ID cardhave been recognized from the video, the door phone plays a message“Please turn the object.” by using the loudspeaker. The camera continuesto shoot while the user turns the object. The door phone analyzes thethree-dimensional shape of the object based on the video. The door phoneplays a message “Please bring the object closer to the near fieldcommunicator of the door phone.” by using the loudspeaker and performsnear field communication with the IC chip on the object to acquire theidentification number. By using the acquired identification number, thedoor phone acquires the prestored information about thethree-dimensional shape of the object and the prestored facial image ofthe user. The door phone acquires a facial image of the user from thevideo and compares the acquired facial image against the prestoredfacial image of the user. Further, the door phone compares thethree-dimensional shape of the object analyzed based on the videoagainst the prestored information about the three-dimensional shape ofthe object. If these two comparisons each find a match, the door phoneunlocks the door. If one of or both of the two comparisons find nomatch, the door phone plays a message “Information on you or the objectdid not match registered information.” by using the loudspeaker andterminates the process.

The configuration of the information processing apparatus described ineach of the exemplary embodiments is an example and may be changed asappropriate without departing from the gist.

The processing flow of the program described in each of the exemplaryembodiments is an example and any step may be deleted, a new step may beadded, or the order of processes may be changed without departing fromthe gist.

The information processing and the photo/video shooting executed byreading software (programs) in the CPU in each of the exemplaryembodiments may be executed by various processors other than the CPU.Examples of the processor include a programmable logic device (PLD) suchas a field programmable gate array (FPGA), in which the circuitstructure may be changed after manufacture, and a dedicated electriccircuit such as an application specific integrated circuit (ASIC), whichis a processor having a dedicated circuit structure designed forexecution of a specific process. The process for shooting a photo orvideo and the process for acquiring personal information may be executedby one of the various processors or by a combination of two or moreidentical or different types of processor (for example, a combination ofa plurality of FPGAs or a combination of a CPU and an FPGA). Morespecifically, the hardware configuration of each of the variousprocessors is an electric circuit manufactured by combining circuitelements such as semiconductor elements.

In each of the exemplary embodiments, the programs for the informationprocess and the process for shooting a photo or video are prestored(preinstalled) in the storage 16 but may be provided by being recordedin a recording medium such as a compact disk read only memory (CD-ROM),a digital versatile disk read only memory (DVD-ROM), or a universalserial bus (USB) memory. The programs may also be downloaded from anexternal apparatus via a network.

The foregoing description of the exemplary embodiments of the presentdisclosure has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit thedisclosure to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiments were chosen and described in order to best explain theprinciples of the disclosure and its practical applications, therebyenabling others skilled in the art to understand the disclosure forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of thedisclosure be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing apparatus, comprising:a processor configured to: receive image data from a camera; detect aperson and an object in the image data; receive information read from anIC chip on the object, the information being (i) personal information ofthe person or (ii) information used to retrieve the personal informationof the person from a database; and execute a predetermined process usingthe personal information.
 2. The information processing apparatusaccording to claim 1, wherein the detection comprises detecting theperson performing a predetermined action in the image data while holdingthe object.
 3. The information processing apparatus according to claim2, further comprising a reader, wherein the reading of the informationfrom the IC chip on the object is performed by the reader.
 4. Theinformation processing apparatus according to claim 3, wherein thepredetermined action is bringing the object with the IC chip closer tothe reader, wherein the reading of the information from the IC chip onthe object is done by near field communication.
 5. The informationprocessing apparatus according to claim 2, wherein the detection furthercomprises detecting the predetermined action being performed within apredetermined period before the reading of the information from the ICchip.
 6. The information processing apparatus according to claim 3,wherein the detection further comprises detecting the predeterminedaction being performed within a predetermined period before the readingof the information from the IC chip.
 7. The information processingapparatus according to claim 4, wherein the detection further comprisesdetecting the predetermined action being performed within apredetermined period before the reading of the information from the ICchip.
 8. The information processing apparatus according to claim 1,wherein the processor is further configured to: provide at least one ofan audio guide, an image guide, or a text guide, so that the person andthe object with the IC chip fit in a shooting area of the camera.
 9. Theinformation processing apparatus according to claim 2, wherein theprocessor is further configured to: provide at least one of an audioguide, an image guide, or a text guide, so that the person and theobject with the IC chip fit in a shooting area of the camera.
 10. Theinformation processing apparatus according to claim 3, wherein theprocessor is further configured to: provide at least one of an audioguide, an image guide, or a text guide, so that the person and theobject with the IC chip fit in a shooting area of the camera.
 11. Theinformation processing apparatus according to claim 4, wherein theprocessor is further configured to: provide at least one of an audioguide, an image guide, or a text guide, so that the person and theobject with the IC chip fit in a shooting area of the camera.
 12. Theinformation processing apparatus according to claim 8, wherein theprocessor is further configured to: notify the person if no person or noobject is detected in the image data.
 13. The information processingapparatus according to claim 8, further comprising a display that, whilethe image data is received from the camera, displays the received imagedata with a first frame and a second frame to guide positions of theperson and the object, wherein the processor is further configured to:if the person and the object are not positioned as guided by the firstframe and the second frame, provide a prompt to adjust positions of theperson and the object as guided by the first frame and the second frame.14. The information processing apparatus according to claim 8, furthercomprising a display that, while the video is received from the camera,displays the received image data with a first frame and a second frameto guide positions of the person and the object, wherein the processoris further configured to: if more than one person is detected in thefirst frame or more than one object is detected in the second frame,provide a prompt to place only one person in the first frame and onlyone object in the second frame.
 15. The information processing apparatusaccording to claim 14, wherein the processor is further configured to:if more than one person is detected in the first frame or more than oneobject is detected in the second frame, provide a prompt to place onlyone person in the first frame and only one object in the second frame.16. The information processing apparatus according to claim 1, whereinthe controller is further configured to: refrain from the execution ofthe process, if comparison of a result of the analysis of the image dataagainst the personal information does not find a correspondence.
 17. Theinformation processing apparatus according to claim 16, wherein thepersonal information comprises a preregistered character string, andwherein the comparison is performed to determine whether thepreregistered character string corresponds to a character string on theobject in the image data from the camera.
 18. The information processingapparatus according to claim 16, wherein the personal informationcomprises a preregistered image, and wherein the comparison is performedto determine whether the preregistered image corresponds to an image onthe object in the image data from the camera.
 19. The informationprocessing apparatus according to claim 16, wherein the personalinformation comprises a preregistered shape, and wherein the comparisonis performed to determine whether the preregistered shape corresponds toa shape of the object in the image data from the camera.
 20. Anon-transitory computer readable medium storing an informationprocessing program causing a computer to execute a process comprising:receiving image data from a camera; detecting a person and an object inthe image data; receiving information read from an IC chip on theobject, the information being (i) personal information of the person or(ii) information used to retrieve the personal information of the personfrom a database; and executing a predetermined process using thepersonal information.